Deprecate XendDomainInfo.state - now use _stateGet() to get the live
state of a domain.  Should still call _stateSet() to notify others
when you expect the state has changed.

Also some changes to locking in save/suspend, restore/resume and migrate

Passes xm-test against XenAPI...

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Revert 14883:6568c1882af5 and 14862:98efd2e410ae.

This reverts the preparation for removing the sparse tree, since these
modified scripts are not yet ready:
 1. XENGUEST suffix was lost yet depended on still by sparse tree
 Makefiles (hacked around by 14883; also reverted).
 2. XEN_TARGET_X86_PAE default value seems to be ignored
 (out-of-the-box 'make dist' will build non-PAE kernels).

Signed-off-by: Keir Fraser <keir@xensource.com>

[XEND] Fix test for when to record HVM VNC console as a VFB.
This code may still need more work to properly integrate HVM SDL consoles.
Signed-off-by: Tim Deegan <Tim.Deegan@xensource.com>

Fix dist target to keep previous symlink format.
May be a cleaner fix which I'll let IanC do.

Signed-off-by: Steven Hand <steven@xensource.com>

Update README for correctness.
Signed-off-by: Keir Fraser <keir@xensource.com>

hvmloader: Fix ROMBIOS highmem relocation. Only SHF_ALLOC sections
should be relocated. SHT_NOBITS must be handled properly (space
explicitly allocated and zeroed).
Signed-off-by: Keir Fraser <keir@xensource.com>

Add "chk build" check that we've got xgettext since it's now required.
Signed-off-by: Mats Petersson <mats.petersson@amd.com>

[vtpm] Return a proper error when in the Xen-API call.
Fix a bug in the test.

Signed-off-by: Stefan Berger <stefanb@us.ibm.com>

[security] When building the binary policy align its contents the same way as the
ACM module does when returning its contents.
Signed-off-by: Stefan Berger <stefanb@us.ibm.com>

hvmloader: Simplify e820_malloc() interface and improve
implementation. Strip unnecessary sections from the highmem bios
extension elf image.
Signed-off-by: Keir Fraser <keir@xensource.com>

hvmloader: Tiny comment clarification.

Fix for bug introduced by cset 14859:a9aa7c29eda8 - implement IOREQ_TYPE_SUB
for intercepted mmio access too.

Signed-off-by: Steven Hand <steven@xensource.com>

Allow use of foo.local buildconfig overrides.
From: Jeremy Fitzhardinge <jeremy@goop.org>
Signed-off-by: Keir Fraser <keir@xensource.com>

netfront: use skb.cb for storing private data

Netfront's use of nh.raw and h.raw for storing page+offset is a bit
hinky, and it breaks with upcoming network stack updates which reduce
these fields to sub-pointer sizes.  Fortunately, skb offers the "cb"
field specifically for stashing this kind of info, so use it.

Signed-off-by: Jeremy Fitzhardinge <jeremy@xensource.com>
Cc: Herbert Xu <herbert@gondor.apana.org.au>
Cc: Chris Wright <chrisw@sous-sol.org>
Cc: Christian Limpach <Christian.Limpach@cl.cam.ac.uk>

tools: Use INSTALL_{DIR,DATA} to install stuff.
Signed-off-by: Keir Fraser <keir@xensource.com>

Fix tools build

Signed-off-by: James Bulpin <james@xensource.com>

Add *.get_all_records to XenAPI, make use of this for xm list

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Added event dispatch when a VM's power state changes.  Fix the host.enabled and
host.software_version definitions.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

Add pot file, fix build

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Added documentation and C bindings for VM.migrate call.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

Added host.enabled flag.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

Install dtd into correct place

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Fix up locale strings for xm

Signed-off-by: Daniel P. Berrange <berrange@redhat.com>

hvm: Fix get_immediate() in mmio decoder by reverting Dexuan Cui's
change that breaks the case mod==0, rm==4, sib&7==5. That is,
disp32(scaled-index).
Also simplify get_immediate with sign extension.
Signed-off-by: Keir Fraser <keir@xensource.com>

Factor out sparse tree makefile fragments and introduce an alternative hg-clone
method in preparation for migrating away from the sparse tree layout.

Signed-off-by: Ian Campbell <ian.campbell@xensource.com>

hvm: Allow HVM guests to use sched_op() hcall on x86/64 Xen.
Signed-off-by: Keir Fraser <keir@xensource.com>

xen x86: Fix PV guest destruction.
Signed-off-by: Dexuan Cui <dexuan.cui@intel.com>

hvm: Fix a bug in the mmio emulation of SUB instruction.
Signed-off-by: Dexuan Cui <dexuan.cui@intel.com>

Fix map_pages_to_xen() to atomically switch between valid mappings.
This is needed to successfully boot a debug=y build of xen on kvm.
Reported by Jeremy Fitzhardinge <jeremy@goop.org>
Signed-off-by: Avi Kivity <avi@qumranet.com>
Signed-off-by: Keir Fraser <keir@xensource.com>

Added documentation, C bindings, and test for VM_metrics.VCPUs_flags.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

Added documentation and C bindings for VBD. and VIF.runtime_properties.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

[HVM][SVM] Save/restore: set CPL from SS.DPL on restore
(not needed on VMX, which doesn't keep the CPL separately from SS.DPL)
Signed-off-by: Tim Deegan <Tim.Deegan@xensource.com>

Merge with xen-ia64-unstable.hg

Fix TypeError with datetime() on old python version

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

[IA64] Fix ptc.ga emulation

ptc.ga infrequently clobbers the region register 0.

When vcpu1 purges TLBs of vcpu2 and ptc_ga_remote_func() is called
locally not via IPI (i.e. vcpu1 shares the same pcpu with vcpu2),
in ptc_ga_remote_func(),

  save vrr[0] of vcpu2
  ... => switch to vcpu2 and set a new value of vrr[0]
  restore vrr[0] of vcpu2 // the new value is lost

Windows will crash due to this issue.

Signed-off-by: Kouya Shimura <kouya@jp.fujitsu.com>

linux netfront: Fixes to locking after lockdep-derived changes, as
suggested by Herbert Xu.
Signed-off-by: Keir Fraser <keir@xensource.com>

hvm: Clean up treatment of is_dying per-domain boolean. All critical
checks are done under an appropriate lock, allowing the lock-free
protocols surrounding this boolean to be removed.

Also simplification and fixes to code for setting/zapping the ioreq
and buf_ioreq shared pages.

Signed-off-by: Keir Fraser <keir@xensource.com>

Add VM.migrate to XenAPI, add support to XM

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

hvm: Fix some bugs in mmio decoder

Some instructions, like "add $imm8, r/m16"/"MOV $imm32, r/m64" require
the src immediate operand be sign-extented befere the op is executed,
but this is omitted in the current Xcode. The patch fixes this.
The patch also fixes an issue in handling address-size override
prefix, and fixes an issue in get_immediate().

Signed-off-by: Dexuan Cui <dexuan.cui@intel.com>

hvm: Xen must take care to hold a reference to ioreq pages, to ensure
that domain runs only when it has valid mapped ioreq pages, and to
safely drop ioreq page references when a domain dies.
Signed-off-by: Keir Fraser <keir@xensource.com>

Update .hgignore so it doesn't ignore buildconfigs/* only build-*

Signed-off-by: Ian Campbell <ian.campbell@xensource.com>

Simplify code to map interfaces to bridges

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

linux: netfront contains two locking problems found by lockdep:

1. rx_lock is a normal spinlock, and tx_lock is an irq spinlock.  This
   means that in normal use, tx_lock may be taken by an interrupt
   routine while rx_lock is held.  However, netif_disconnect_backend
   takes them in the order tx_lock->rx_lock, which could lead to a
   deadlock. Reverse them.
2. rx_lock can also be used in softirq context, so it should be
   taken/released with spin_(un)lock_bh.

Signed-off-by: Jeremy Fitzhardinge <jeremy@xensource.com>

pygriub: Fix GPT support.
- 64 bit support for starting of a GPT partition.
- detect partition types precisely.

Signed-off-by: KUWAMURA Shin'ya <kuwa@jp.fujitsu.com>

hvm svm: Fix nested paging to support domain save/restore.
Signed-off-by: Wei Huang <wei.huang2@amd.com>

Merge with xenppc-unstable-merge.hg

Merge with xen-ia64-unstable.hg

libxenguest: Remove bogus weak definitions of xc_{set,get}_hvm_param().
Signed-off-by: Keir Fraser <keir@xensource.com>

[XEN][POWERPC] Fix dom0 boot when using built-in zImage.
We need to respect the ELF entry point.
Signed-off-by: Jerone Young <jyoung5@us.ibm.com>
Signed-off-by: Hollis Blanchard <hollisb@us.ibm.com>

[XEN][POWERPC] Fix debug=y build.
When debug=y, we use -O0 for single-stepping. This breaks the force-link-error
trick used in __xchg(), so we provide a real function to link with.
Signed-off-by: Hollis Blanchard <hollisb@us.ibm.com>

merge with xen-unstable.hg

[IA64] Fix hyper_get_psr

It didn't return correct psr.i value.

Signed-off-by: Isaku Yamahata <yamahata@valinux.co.jp>

[IA64] Formatting fix

This extra space after the newline causes printk to get confused
and re-evaluate do_print and leave start_of_line == 0.  Anything
printed after this will always print, regardless of intended
log level.

Signed-off-by: Alex Williamson <alex.williamson@hp.com>

[XEN][POWERPC] Fix garbage dom0 commandline.
Debugged by Amos Waterland <apw@us.ibm.com>.
Signed-off-by: Hollis Blanchard <hollisb@us.ibm.com>

[XEN][POWERPC] Fix xchg macro.
Signed-off-by: Jerone Young <jyoung5@us.ibm.com>
Signed-off-by: Hollis Blanchard <hollisb@us.ibm.com>

Merge

[HVM] Save/restore: catch more error cases in the tools
Signed-off-by: Tim Deegan <Tim.Deegan@xensource.com>

Add PyXML requirement for xm via XenAPI to docs

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

[HVM] Fix typo that broke x86_64 build
Signed-off-by: Tim Deegan <Tim.Deegan@xensource.com>

[HVM] Save/restore: save HVM GPRs and DRs with the rest of the CPU state
and remove the use of xc_vcpu_getcontext() from HVM save/restore.
Also fixes loss of CR2, DR6 and DR7 contents across HVM save/restore.
Signed-off-by: Tim Deegan <Tim.Deegan@xensource.com>

HVM: First attempt at domain-resume on save-failure.

Not working yet as we are a bit too keen to kill the qemu-dm process,
before we know that the save has been successful.

Signed-off-by: Keir Fraser <keir@xensource.com>

HVM: Allow qemu monitor to be configured in domain config file.
From: Yongkang You <yongkang.you@intel.com>
Signed-off-by: Keir Fraser <keir@xensource.com>

xend: Update config-format version, due to changes in 3.0.5.
Signed-off-by: Daniel P. Berrange <berrange@redhat.com>

Ensure xenapi create passes in values even if unused

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

HVM: Do not watch control/shutdown to force domain shutdowns when PV
drivers are not present. The feature-foo mechanism does not actually
work after save/restore since the fields do not get rewritten. And it
doesn't work when we actually need the guest to be shutdown through
Xen (e.g., on suspend). Since we can quite reasonably assume that the
only entity to screw with control/shutdown is xend, and since the one
place that does that now explicitly handles unenlightened HVM guests,
we can simply strip all this stuff out.

This has the nice benefit of making HVM save/restore with PV drivers
much more reliable.

Signed-off-by: Keir Fraser <keir@xensource.com>

PV-on-HVM: More carefully synchronise with APs when putting them to
sleep in a spin loop.
Signed-off-by: Keir Fraser <keir@xensource.com>

Make xm info more permissive

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Make Xm Test default to bridge when cannot read config file

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Fix typo and make create send proper bools

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

PV-on-HVM: Fix 64-bit build.
Signed-off-by: Keir Fraser <keir@xensource.com>

[IA64] Fix PV-on-HVM driver

xen-platform-pci fails to load w/ undefined symbols for some of the
sched_op hypercalls in machine_reboot.c.  This adds them to xencomm
mini to allow them to be called from modules.

Signed-off-by: Alex Williamson <alex.williamson@hp.com>

[IA64] Bugzilla 942 Fix (timer strangeness on restored PV domain)

Time interpolator remembers last status.  When domain is restored, it
should be forgotten. Otherwise the interpolator causes bad timer value.

Signed-off-by: Isaku Yamahata <yamahata@valinux.co.jp>

[ioemu] Consistently extend all block device operations to include scsi disks.

Signed-off-by: Christian Limpach <Christian.Limpach@xensource.com>

[setup] Fix old style bridge setup.
Also only warn that we ran out of veth interfaces if we have any at all.

Signed-off-by: Christian Limpach <Christian.Limpach@xensource.com>

Add documentation and C bindings for VM.add_to_VCPUs_params_live,
VM.set_memory_dynamic_{min,max}_live.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

Added documentation and bindings for host_cpu.features.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

linux: Quieten blkfront output.
Signed-off-by: Keir Fraser <keir@xensource.com>

xend: Store canonical vnif config info in /vm/<uuid>/device
rather than in frontend store directory. Two advantages are that the
frontend cannot mess with the config information; also an
ioemu-specific vif does nto need a frontend directory at all. This
avoids confusing netfront pv-on-hvm driver.
Signed-off-by: Keir Fraser <keir@xensource.com>

merge with xen-unstable.hg

[IA64] Skip MCA setup on domU

This effectively automates passing the nomca flag to domUs,
preventing them from setting up CMC/CPE interrupts.  This saves
3 dynamic IRQs per processor and allows us to get domUs up to 64
vCPUs without increasing the number of dynamic IRQs available.

Signed-off-by: Alex Williamson <alex.williamson@hp.com>

[IA64] Handle NAT bit for dom0 and domU

This fixes ia32 apps running under the IA32-EL.

Signed-off-by: Anthony Xu <anthony.xu@intel.com>

PV-on-HVM: Fixes for module loading.
Signed-off-by: Keir Fraser <keir@xensource.com>

PV-on-HVM: More save/restore fixes.
Signed-off-by: Keir Fraser <keir@xensource.com>

linux: Fix an error path in save/restore code.
Signed-off-by: Keir Fraser <keir@xensource.com>

[TAPDISK] Fix qcow initialization bug.

fd_end was being incorrectly initialized upon open, leading to data corruption.

Signed-off-by: Jake Wires <jwires@xensource.com>

Added docs and bindings for VM_metrics.state.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

[linux] Make CONFIG_XEN_COMPAT #if statements syntactically correct.

Signed-off-by: Christian Limpach <Christian.Limpach@xensource.com>

LINUX: Cleanup a few stray uses of CONFIG_XEN_COMPAT_030002.

Signed-off-by: Ian Campbell <ian.campbell@xensource.com>

Merge with xen-ia64-unstable.hg

Provide the use of SCSI disks in HVM domains.  Currently there is a
maximum of 7 scsi disks and an ide disk must still be used to boot.

Signed-off-by: Natasha Jarymowycz <natasha@us.ibm.com>
Signed-off-by: Keir Fraser <keir@xensource.com>

Fix pygrub for IA64 support.
Signed-off-by: Shinya Kuwamura <kuwa@jp.fujitsu.com>
Signed-off-by: Tomohiro Takahashi <takatom@jp.fujitsu.com>

pygrub: Support GPT (GUID Partition Table) as used by EFI.
Signed-off-by: Shinya Kuwamura <kuwa@jp.fujitsu.com>
Signed-off-by: Tomohiro Takahashi <takatom@jp.fujitsu.com>

libfsimage: Fix data types for 64-bit architectures.

In particular __u32 instead of ulong.

Signed-off-by: Tomohiro Takahashi <takatom@jp.fujitsu.com>
Signed-off-by: Keir Fraser <keir@xensource.com>

Merge

[HVM] Save/restore: merge xc_linux_save and xc_hvm_save
into xc_domain_save, like we did for xc_domain_restore
Signed-off-by: Tim Deegan <Tim.Deegan@xensource.com>
--HG--
rename : tools/libxc/xc_linux_save.c => tools/libxc/xc_domain_save.c

linux: Fix IRQ disable/enable logic across save/restore.
stop_machine_run() executes our callback function with interrupts
disabled.
Signed-off-by: Keir Fraser <keir@xensource.com>

Added docs and bindings for VM.{send_trigger,send_sysrq}.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

Avoid using the multicol package.

Signed-off-by: Ewan Mellor <ewan@xensource.com>

Make date time handling slightly more permissive

signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

merge with xen-unstable.hg